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Chaotic synchronization is generally extremely sensitive to the presence of noise and other in- 
ference in the channel. Is this sensitivity a fundamental property of chaotic synchronization or is 
it related to the choice of synchronization method and can it be suppressed by a modification of 
the method? If the answer is positive, then what are the relationships between the properties of a 
dynamical system and the level of noise at which the suppression of this sensitivity is still possible? 
What are particular methods to achieve synchronization stable to the presence of noise? In this 
paper we present the analysis of this issue from the standpoint of information theory. The fun- 
damental reason for this sensitivity is the fact that the chaotic signal contains information which 
requires a certain minimal threshold signal-to-noise ratio for transmission. Only in this case high- 
quality synchronization is achievable and only if the required information is transmitted (coded) 
optimally. Otherwise the threshold level can be much higher. 

PACS numbers: 05.45.-a,07.50.Qx,95.75Wx 



I. INTRODUCTION 



The possibility to synchronize the dynamics of two 
identical chaotic systems ||^, ^, ^, ^ is determined by 
two factors (to be precise the case of unidirectional im- 
pact of one system on the other is assumed, i.e., the sit- 
uation "drive system - response system" is considered). 
First, the way the drive system affects the response sys- 
tem. Significant progress has been achieved here that 
enables synchronization not only of chaotic systems but 
also of systems with hyperchaos [|[ ^ . Second, it is deter- 
mined by the sensitivity of the chaotic synchronization to 
distortions of the signal in the coupling channel, in par- 
ticular, to the effects of filtering and to the presence of 
noise Q . The attempts to damp this sensitivity are being 
made both in the direction of development of more robust 
schemes ^ and in the direction of correction (recon- 
struction) of a signal, distorted in the coupling channel, 
into its original form at the input of the responce system. 
For instance, in the case of a noisy signal, the reconstruc- 
tion is considered to be the cleaning of this signal from 
111, 1, 



noise 
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Hence, the problem is to 
reconstruct with a high precision the output signal of the 
drive system at the input of the response system. How- 
ever, for this purpose, transmission of the signal itself 
through the coupling channel is not necessary. Instead, 
one can transmit the minimal information about the sig- 
nal necessary to reconstruct (recover) the initial signal 
at the input of the response system, i.e. to replace the 
coupling channel by the communication channel. From 
the viewpoint of the information theory the second ap- 
proach to reconstruction of the signal at the input of the 
response system can be preferable as it (i) requires less 
information to be transmitted and (ii) this information 
can be presented (coded) so that it is more robust to the 



disturbances in the communication channel. 
This idea was discussed in the literature 
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and 



was tested in the case when the chaotic systems were 
one-dimensional maps |p^ . Here, on the example of two- 
dimensional maps we show that this approach can be 
used for synchronization of a higher-dimensional chaotic 
maps (both hyperbolic and non- hyperbolic) . 

As an example of two-dimensional maps the hyperbolic 
Lozi map [ p8[ is used in this paper. It is described by the 
equations 



Xn+l = [a - I) - a\Xn\ + Vn, 
Vn+l = f3Xn, 



(1) 



where a and (3 are parameters. 

Non-hyperbolic maps are represented here by the 
Hcnon map ||T^ 

Xn+l = l-axl+Un, 

Un+l = l3Xn, (2) 



II. RESTRICTIONS FROM INFORMATION 
THEORY ON SYNCHRONIZATION 

Drive chaotic system is a specific source of information. 
With respect to information transmission, the driven sys- 
tem can be treated as a receiver of information, that, if 
synchronization takes place, receives all the information 
defining the state of the dynamical system, that is sent 
through the communication channel and continuously ad- 
justs its dynamics in accordance with the information 
received. 

Characteristic of a chaotic source are a finite rate of 



information production pC 
values. A question arises. 



2l| ] and continuous signal 
rat the necessary carrying 
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capacity of a communication channel between the two 
systems is and how it relates to the possibility of high- 
quality synchronization. 

According to Shannon's theorem [ p2[ , in order to trans- 
mit without errors information produced by the source 
at rate / through a channel of capacity C one must have 



C>I. 



(3) 



Hence, for synchronization of the drive and response sys- 
tems in the presence as well as in the absence of noise it 
is sufficient to have a communication channel with a car- 
rying capacity larger than /. This fact has been noticed 
in ]l6[ | . It suggests that high-quality synchronization can 
be achieved, if external perturbations do not exceed some 
critical value. 

The theorem also lays the basis for the quantitative 
analysis of the capacity of a noisy channel. For a channel 
with additive white gaussian noise, and bandwidth W 
the capacity per unit of time is 



C = M^log2 



P + N 
N 



(4) 



where P is the signal power and N is the noise power. 

Taking the sampling period at T = so that the 
whole bandwidth is used, capacity per sample becomes 



(5) 



Eq. (^) implies that when appropriate coding is used, 
information can be transmitted with the rate up to 
M^-log2^^ bit/sec while error probability can be arbi- 
trarily low. 

Equation (||) also suggests that if the information pro- 
duction rate / and the channel capacity are known, the 
maximum noise level can be calculated such that high- 
quality synchronization is still feasible. 

As an example, if / = 1 bit/sample, then, in theory, 
arbitrarily precise synchronization can be achieved when 
the ratio of the mean squared power of the chaotic signal 
P =< > to mean squared power of gaussian noise 
N =<wl> is 

P/N > 3. 

The "expense" of the possibility of high precision syn- 
chronization in the presence of noise is a special organiza- 
tion of the information transmitted through the channel 
and a certain time delay of the processes in the response 
system with respect to the drive system. Note also, that 
for the practical accomplishment of high-quality synchro- 
nization in the presence of noise a certain increase of the 
channel capacity is necessary compared to the value given 
by relation (H). Otherwise, the delay value will tend to 
infinity. 



III. HYPERBOLIC CASE. LOZI MAP. 

So, in order to be able to synchronize the response 
system with the drive system we should transmit infor- 
mation at a certain rate. Let us consider the information 
production of the Lozi map and the amount of informa- 
tion that must be transmitted for synchronization. 

First, let us recall that for 1-D maps 



Xn+l = fiXn) 



(6) 



the average information production /, measured in bits 
per sample, can be expressed as the integral of (j^) 
weighted with the invariant probability density P{x) 



P{X) log2 



dx 



dx. 



(7) 



Relation (|^) coincides with the definition of the Lya- 
punov exponent A of the one-dimensional map with the 
only difference that in the relation for the Lyapunov 
exponent the natural logarithm is used instead of the 
base-2 logarithm. Hence, the Lyapunov exponent for 
1-D map can be treated as the information production 
rate expressed in base-e units and it is equivalent to 
the Kolmogorov entropy h. In order to transform it 
to bit/sample, we multiply A by log2e. Let us remark 
that the Kolmogorov entropy h and the information pro- 
duction rate R are generally the same not only in the 
case of 1-D maps, but also in more general cases. How- 
ever, it is common to express R in bits/sample and h in 
nats/sample. 

The situation with information production in 2-D 
maps, e.g. in the Lozi map, is more complicated. It is 
well known [ pT| that for differentiable maps the following 
inequality between Kolmogorov entropy h and positive 
Lyapunov exponents holds: 

h<\i + As, (8a) 

if both Lyapunov exponents are positive, or 

h<Xi, (8b) 

if only Ai is positive. Under some additional conditions 
inequalities (|) can turn into equalities. There are no 
similar results for the non-differentiable Lozi map. How- 
ever, one can try to use another approach to estimate the 
information production by the Lozi map. 

Let Nn be the number of unstable periodic orbits of 
length n in the chaotic attractor, and thus Ln = Nn ■ n 
the number of cyclical points. Then the following limit 
is supposed to estimate topological entropy 



lim — In L.y_ 

n^oo n 



(9) 



Estimates for information production /„ , calculated with 
the aid of (||) are presented in Table | for different n. 
Both methods of estimating information production (in- 
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TABLE L Periodic orbits of Lozi map attractor. {a = 1.1,13 — 
0.5); n - the length of a cycle; A'^„ - the number of cycles 
with the length n; Ln - the number of periodic points; I„ - 
information production estimate. 
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FIG. 1: Information production of Lozi map as a function of 
parameters a and /3. 



eluding the method based on the positive Lyapunov ex- 
ponents ) give similar results. 

Fig. shows the average information production for 
different values a and f3. For a — 1.7; /3 = 0.5 the average 
information production rate is I ~ 0.7 bits/sample. 

However, information production differs from iteration 
to iteration. Fig. |^ shows the information production rate 
probability density function. As can be seen in the figure 
the rate never exceeds 1 bit/sample. 

Consequently, to ensure synchronization a channel 
with capacity C > I — 0.7 bits/sample can be used. 
However, it is desirable that the channel capacity should 
be at least C = Imax = 1 bit /sample in order to take the 
maximum information production of each sample into ac- 
count. Below a symbolic sequence for Lozi map is studied 
as an example of such a binary sequence. 

Synchronization scheme 

The proposed scheme is shown in Fig. |^. The signal 
Xn produced by iteration of the Lozi map is transformed 
by a 2-level quantizer (threshold device) into a symbolic 
sequence X„ = sign(a;„), i.e. into -1 if x„ < and into 
if a;„ > 0. Then this binary signal is sent through the 
channel, where it is corrupted by noise 1 — -^n ~t- Wn, 
The quantizer transforms it back to the binary signal 
Xn = sign(z„). 

The ±1 values of binary sequence correspond to sym- 
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FIG. 2: The probability distribution function of the rate of 
information production of the Lozi map. 
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FIG. 3: Synchronization by means of symbolic sequence. CS- 
chaotic source. C-R-chaotic receiver, _K'2-quantizer. 



bols L and R of the symbolic sequence. This symbolic 
sequence is used in the reconstruction block to restore the 
chaotic sequence. Thus, in the absence of noise, chaotic 
sequence reconstructed with a high precision is fed to 
the input of the response system, or an estimate of this 
chaotic sequence, if there is noise. 

First, a problem with the noisefree case will be ana- 
lyzed. 

Reconstruction of a Trajectory from Symbolic 
Sequence 

According to the synchronization scheme, at the input 
of the response system the incoming symbolic sequence 
must be used to reconstruct the chaotic sequence gener- 
ated by the chaotic source. 

In the case of one-dimensional maps reconstruction of 
the chaotic sequence based on the symbolic sequence can 
be accomplished by iterating the map backward p6| , pT[ . 
Since the map is stretching, being iterated backward it 
becomes contracting. Hence, repeatedly applying the in- 
verse map to the initial conditions given by the elements 
of the symbolic sequence can give a good estimate of the 
chaotic sequence. 

Consider a procedure of reconstruction of a chaotic se- 
quence given the symbolic sequence for the case of Lozi 
map. 

The Jacobian of (|l|) is constant and equals /3. This 
means that the area of a small cell will be contracted by 
each iteration of the Lozi map by a factor /3. But the 
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distance between two close points increases in a certain 
direction, the stretching direction, at a rate determined 
by the positive Lyapunov exponent Ai. Let two points 
in the plane be separated along the stretching direction 
by the small distance Sq at time 0. Then the distance 
between the corresponding trajectories at moment m is 
approximately 



Sxm oc Sq • exp(Ai • to). 



(10) 



The situation is very similar to the case of the 1-D map, 
where one could use this property (^) of the map to 
improve our knowledge of the value of the trajectory at 
present on the basis of information about its values in 
the future. Namely, to improve the precision of Xn the 
map should be iterated in reverse time beginning from 

Xn+k- 

But what happens if we iterate the Lozi map in reverse 
time? In this case the area of a small cell will not decrease 
but increase. The direction corresponding to the positive 
Lyapunov exponent will be contracting but the direction 
corresponding to the negative Lyapunov exponent will 
be stretching. The trajectories will diverge again. The 
rate of this divergence will be determined by the absolute 
value of the second Lyapunov exponent. 

The fact that two trajectories will diverge when the 
map is iterated either forward or backward can be written 
as 



Sxm oc Sq ■ exp(Ai • m) + eg ■ exp(A2 • to). 



(11) 



where Sq is the initial distance between the two points 
in the direction of contraction. As follows from ([Tl|), in 
order to improve the knowledge about the position of 
the trajectory at the present time, it is necessary to use 
information both about the "future" and the "past" of 
the trajectory. 

We rewrite equations (|l|) for the Lozi map in such a 
way as to make it contracting both from the future and 
from the past: 



1 1 



— Xn+l 

a 



a 



(12) 



Map ( p^ ) is a contracting map because coefficients 1 /a 
in front of Xn+i and P/a in front of a;„_i(a = 1.7, /3 = 
0.5) as well as their sum are less than 1. Contracting fea- 
tures of map dl^ ) may be used to improve an estimate of 
the variable value at the n-th moment using information 
about the variable values at the (n— l)-th and {n + l)-th 
moments. Note that map (|l^) is not single- valued but a 
double valued map. 

Reconstruction algorithm. So, let us have a sym- 
bolic sequence Xi, . . . Xn, ■ ■ ■ Xn+k, ■ ■ ■ Xpf, where Xk G 
{—1,1}: N is the number of elements in the sequence. 
We evaluate |a;„| at the first step for all elements besides 
the first and the last, i.e. for n = 2, . . . , — 1 in the 
following way 



Cn — A„ I a;„ I — X„ 



:- 1 1 /3 
Xn+l H Xn-1 

a a a 



(13) 
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FIG. 4: Reconstruction of chaotic sequence by means of sym- 
bolic sequence, n — reconstructed point index, A(n) — re- 
construction error, = 10, 40, 70, 100 — the number of ele- 
ments of the symbolic sequence that are used for reconstruc- 
tion. 



Elements of the symbolic sequence are used at this 
stage as initial approximation for the estimate. At the 
«-th step of the procedure the estimates obtained at the 
previous (i-l)-th step are used. 



Xn — A„|x„| — Xn 



a - 1 1 

X 

a a 



i-l 
n+1 



(14) 



where n = 2, . . . , A^ — 1. We finish the process when the 
difference between estimates of on z-th and i + 1-th 
iterations is less then some small e. 

The results of chaotic sequence reconstruction using 
the above algorithm are presented in Fig. ^. The four 
curves in Fig. ^ correspond to the relative precision (in 
dB) obtained by taking N = 10, 40, 70 and 100 points of 
the symbolic sequence. Each of these curves looks as two 
sides of a triangle. 

Consider the longest curve, that shows the results of 
the reconstruction of a fragment 100 points long. It can 
be seen that the first and the last points arc not recon- 
structed at all, they are just the values of the symbolic 
sequence. The precision at these points corresponds to 
the precision of the initial approximation. The best re- 
sult of reconstruction with precision ~ 10~^^ corresponds 
to the region of 30-th point. The ratio of the number of 
points to the left and to the right from this point is 3:7 
or 1:2.3 that is approximately the ratio of the coefficients 
l/a and /3/a in ([l|): (i/a : 1/a = 1 : 2 

Hence, to reconstruct the sequence of chaotic signals 
xi, . . .Xn with a given precision , one first has to calcu- 
late the length of the fragment of the symbolic sequence 
to be used for reconstruction of one point of the chaotic 
sequence. For instance, the length of the fragment equals 
100 when the reconstruction precision is 10~^^. Then, the 
left-edge fragment of the symbolic sequence Ai , . . . Aioo 
is used to reconstruct the 30th point of the chaotic se- 
quence X30. Then the fragment A2, . . . Aioi is used to 
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reconstruct the point X31 of the chaotic sequence and so 
on. As for reconstruction of any given point of the chaotic 
sequence one needs 29 preceding and 70 following points 
of the corresponding symbolic sequence. Reconstruction 
can be accomplished with this precision only for those 
points that are non less then 29 positions distant from 
the left edge and 70 positions distant from the right one. 

IV. NON-HYPERBOLIC HENON MAP 

In the case of non-hyperbolic maps, e.g. the Henon 
map, the approach based on the transmission of the 
symbolic sequence with subsequent reconstruction of the 
chaotic sequence fails to be directly applicable. However, 
an attempt to apply this approach allows to understand 
why the results are insufhcient and helps to develop a 
suitable method. 

Assume first, as in the case of the Lozi map, that a se- 
quence Xn — sign(a;„) is transmitted through the chan- 
nel. Note that the sequence xi, ...xn, ■■■ is not the sym- 
bolic sequence for this case. 

Henon map can be rewritten as a one-dimensional map 
of the second order 

Xn+i = I - ax'l + (3Xn-l. (15) 

When iterated forward, this map is stretching at almost 
all points of the trajectory, that is, the error in the value 
of Xn+i usually is greater than that of Xn- On average, 
the distance between two close points increases exponen- 
tially with time. 

Rewrite ( ]l5| ) in the form 



X„ = - Xn+l + f3Xn-l. (16) 

Map dl^ ) is contracting everywhere but in the region 
of small Xn- \xn\ < £, where e ~ 0.1. Outside this region 
the error of the estimated value of x„ according to (nm is 
smaller than the error of the estimates of x„„i and Xn+i 
that are used to get an estimate of Xn- For small \xn\ 
this is not true, hence, the algorithm analogous to the 
one used for the Lozi map can not be used to reconstruct 
the chaotic sequence with high precision. A typical result 
of the application of this algorithm to the Henon map 
is shown in Fig. ^ (line 2). One can see that there are 
intervals with sharp reduction of reconstruction precision 
and the intervals where the precision of reconstruction 
is relatively high. Deterioration of the precision always 
occurs because of the lack of contracting properties of 
map ([l6| ) for small \xn\- 

Assume that at the reconstruction block the estimates 
of a chaotic sequence at the moments tiq and no -I- 1 are 
known with the desired precision and there is also a copy 
of the Henon map. Then this information is sufficient to 
get the values of the elements of the binary sequence Xn 
for several points with the indices n > uq. For this one 
just have to iterate the Henon map with initial conditions 
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FIG. 5: Reconstruction of chaotic sequence by means of sym- 
bolic sequence. I — the number of reconstructed point, kiV) — 
reconstruction error, the symbolic sequence is reconstructed 
from 100 sample points. 1 — application of the algorithm to 
Lozi map, 2 — application of the algorithm to the Henon map 

(x„g,x„g_i) and construct a "forecast". This "forecast" 
allows to determine the moments of time when the tra- 
jectory goes through a region of small absolute values. 

Since initial conditions usually are known only with 
a finite precision, the correct values for the elements of 
the symbolic sequence can be obtained only for a rela- 
tively short part of the trajectory when the error of the 
"forecast" is much less then the size of the attractor. 

Above, in the description of the algorithm for Lozi map 
it has been noted that for a reconstruction of a chaotic se- 
quence xi, ... a; AT with a high quality precesion it is suffi- 
cient to know the symbolic sequence X„ for n E [2, iV — 1] 
and xi,xn with the desired precision. The same condi- 
tions hold for the case of Henon map given that in the 
range n € [2, iV — 1] there arc no Xn with absolute values 
close to zero. 

Consequently, we arrive at the following algorithm of 
the information transmission from the drive to the re- 
sponse system. Let Vi be the indices of the points where 
the trajectory comes close to zero, = [iyi,Vi+i] - the 
segment of a trajectory limited by two subsequent points 
close to zero (see Fig. ^. Assume that at the input of 
the driven system there is an estimate of the chaotic se- 
quence for all points of /i^. The two last points from 
fii are taken as the initial conditions for the forecast of 
points from /i^+i. Note also that the length of /i^+i is 
initially unknown at the response system side. Since the 
initial conditions for a forecasting trajectory are known 
with some error, a disturbed and undisturbed trajecto- 
ries diverge exponentially and the precision of the fore- 
cast also grows exponentially with the distance from t'i+i . 
Nevertheless, if the length of ^i+i is not very large, one 
can: (1) predict the index of point Ui^2 where the chaotic 
trajectory is close to zero and (2) construct the binary 
sequence Xn for all points from /ii+i. 

At this stage the only single datum needed for chaotic 
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sequence reconstruction is the value at the point 
This value is transmitted through the channel with the 
necessary precision. After that pn+i is reconstructed with 
the aid of the algorithm described for the Lozi map. 
Hence, to reconstruct the chaotic sequence at all points 
of ^i+i one only has to transmit the value of a single 
point (with the index 1^1+2) ■ 

A subtle modification of this algorithm can substan- 
tially reduce the amount of information transmitted. The 
case is that the forecast for the points from /i^+i allows to 
get some estimate for the point x^^j^^ , and so, there is no 
need to transmit the whole value of this point. One just 
needs to transmit the bits that can be distorted due to 
exponential divergence of the trajectories. Since the rate 
of divergence is solely determined by the first Lyapunov 
exponent, the amount of information to be transmitted 
through the communication channel is also determined 
only by this property of the chaotic map and is indepen- 
dent of the desired reconstruction precision of the chaotic 
sequence. 

A numerical simulation of the proposed algorithm en- 
sures high precision of synchronization with a volume of 
transmitted information ^ 1 bits/sample, that is close to 
the rate of information production by Henon map 0.6 
bits/sample). Note that in the method of synchro- 
nization with dynamical coupling was analyzed that al- 
lows to reduce the amount of necessary information to 
be transmitted for synchronization by a factor of 5-6 as 
compared to conventional procedure. The approach con- 
sidered above provides a reduction of information flow by 
a factor of 20-30 in comparison with conventional proce- 
dure. 



SYNCHRONIZATION IN THE PRESENCE 
OF NOISE 




FIG. 7: Synchronization quality for the case of AWGN chan- 
nel. K = [SNRin — SNRout) — the criterion of the synchro- 
nization quality. 



to reconstruct the chaotic sample. The reconstructed se- 
quence of samples ensures high-quality synchronization 
of drive and response systems. 

If binary information is transmitted via a noisy channel 
errors may appear in the binary sequence. These errors 
may lead to incorrect reconstruction of the chaotic signal 
and thus reduce the synchronization precision. 

Consider the results of numerical simulation of the pre- 
cision of synchronization of chaotic signal reconstruction 
after transmission through a noisy channel. Note that 
errors can be made arbitrarily small by increasing the 
channel capacity (e.g., by means of using error correcting 
codes). Hence, synchronization through channels with a 
capacity close to the minimum is of greater concern. 

Fig. shows graphs that illustrate the quality of syn- 
chronization when information is transmitted through a 
channel with gaussian noise. 

It can be seen that for signal to noise ratios up to about 
7.5 dB, the synchronization error is actually given by the 
noise and it cannot be improved by increasing the number 
of points used for the reconstruction of a sample. Above 
this threshold, the synchronization error is decreased by 
about 4.2 dB/points used in the reconstruction, which is 
in good agreement with the rate of information produc- 
tion / of 0.7 bit/sample. 

Similar results were obtained for the synchronization 
of Henon maps. 



It has been shown that in order to achieve synchroniza- 
tion of hyperbolic as well as non- hyperbolic maps it is suf- 
ficient to transmit information contained in the chaotic 
sequence and then utilize this information to reconstruct 
the chaotic sequence. The precision of reconstruction de- 
pends on the length of the sequence and on the number of 
elements of the symbolic sequence that are directly used 



VI. CONCLUSION 

In this paper a synchronization scheme for two- 
dimensional maps is considered that is based on trans- 
mission of information about the state of drive system by 
unidirectional coupling. It is shown that the necessary 
amount of information that must be delivered to the re- 
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sponsc system is determined by the rate of information 
production by the dynamical system. 

When this threshold is increased, however, arbitrarily 
precise synchronization can be achieved. The only price 
to pay for that is the complexity of the reconstruction 
algorithm and the delay of the reconstructed signal. This 
is contrary to the common belief that the synchronization 
error necessarily monotonically increases with the noise. 

The schemes of synchronization of two-dimensional 
maps are presented, that are based on reconstruction of 
the chaotic sequence. Their stability with respect to noise 



almost coincides with the theoretical estimate of the ul- 
timate limit. 
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